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Abstract — Face recognition is still an open problem. Many 2D 
face recognition approaches came into light to achieve high 
recognition rate. But these approaches are still challenged by 
the changes in illuminations, expressions, pose, noise, etc. A 
3D face recognition technique is proposed to overcome such 
challenges and to enhance robustness to expression variations. 
Here, we compare the person at different age groups with 
higher recognition rate in comparison to 2D face recognition 
techniques. We propose a two stage procedure of 3D face 
recognition based on FLD (Fisher Linear Discriminant), SURF 
operator and depth-image. First, FLD is used on depth -image 
to perform recognition and then the SURF features of 2D 
gray images to carry out the refined recognition. Finally, our 
proposed work will increase the robustness in expression 
variations. 

Index Terms — speeded up robust features, fisher linear 
discriminant, depth image, principal component analysis. 

I. Introduction 

A computer application that identifies or verifies a digital 
image or a video of any human is a facial recognition system. 
This can be done by matching that facial image [2] with 
available facial database. This type of recognition system is 
typically used in security systems. Such systems can be 
compared to existing biometrics like nose, fingerprint, eyes 
or whole face recognition systems. 

Most of the face recognition algorithms identify faces by 
extracting features from an image of the subject's face. The 
size of the image, shape of the eyes, nose, and relative position 
of different features of the image are analyzed by the used 
algorithms. The features are used to search for other images 
with matching features. Some other algorithms normalize the 
gallery of face images and then compress the face data. After 
that, only useful data are saved in images which are needed 
for face detection. A probe image is then compared with the 
face data. 

Recognition algorithms being used include Principal 
Component Analysis, Independent Component Analysis, 
Linear Discriminate Analysis, Markov model and many more. 
In recent years the three-dimensional object / face recognition 
technique is emerging and claiming to achieve high 
accuracies. In 3-D face recognition technique a 3-D sensor 
can be used to capture the shape of a face with relevant 
information. The information collected by the 3-D sensor is 
used to identify different features on the surface of a face. 
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These features are as the contour of the face, chin, eye and 
nose. Important factor in 3-D facial recognition is that this is 
not affected by the lighting. This technique can also identify 
a face with other pose angles.Biometric based face recognition 
systems are taken as the efficient technique in biometrics. 
There are some risk factors like hacking or duplication 
possible in fingerprint devices. One more issue when device 
may deny to access if the finger is dirty, wet or injured. Iris 
recognition devices are more interfering devices. Voice 
recognition devices are having some conditions, e.g. if person 
is suffering by throat problem, that time they may fail to give 
correct results. So Face recognition system will be 
recommended even it may not reach to be perfect but this is 
more advanced than other techniques. 

II. Literature Survey 

A. Overview 

Present social world is too complex so the survival of an 
individual depends on the interpreting visual information 
about the personal factors like age, identity and emotional 
state of another person based on that face. Facial expressions 
[2], facial poses, appearance of face and its illumination are 
having a great impact in different adverse conditions. By 
using these, humans can perform face identification with 
good robustness without knowing more about individuals. 
Face recognition researchers using different techniques since 
1970s, and it got a significant importance in the last two 
decades. The reasons behind the growth for face recognition 
system are the possibility of wide range of applications of it 
and the emergence of affordable hardware. Hardware, such 
as digital cameras, made the capturing of high-quality and 
high resolution images more similar. 

Many 2D based approaches such as PCA (principal 
Component Analysis), FLD (Fisher Linear Discriminant), ICA 
(Independent Component Analysis), etc, can achieve high 
recognition rate under some reasonable conditions. However, 
they are still challenged by the changes of illumination, pose 
and expressions. Recent progress in computation, storage 
device and 3D sensors make it possible to perform recognition 
based on 3D face data. 3D face recognition [3, 7, 8, 11] is 
considered to be less influenced by the changes of 
illumination, pose and is more robust to expression variations 
to some extent. Expression variation is still a big problem not 
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only for 2D face recognition but also for 3D face recognition. 
In order to enhance robustness to expression variations, some 
effective ways have been presented. Bronstein et al. [3] used 
the bending-invariant canonical form in constructing 
expression-invariant representations of faces. It is found that 
3D face recognition methods can achieve significantly high 
accuracy rate compared to 2D face recognition, because 3D 
face recognition is a modality of facial recognition methods 
in which the three-dimensional geometry of the human face 
is used. The 3D face recognition also avoids some problems 
of 2D face recognition algorithms such as change in lighting, 
wearing spectacles, different facial expressions, head 
orientation and make-up. The 3D models are used in improving 
the accuracy of image based recognition after transforming 
the head into knows views. 

B. Related Works 

The survey on state of the art in 3D describes the latest 
results and also, the recent research trends, showing that the 
variety and sophistication of algorithmic approaches explored 
are expanding. It is challenging to improve the accuracy in 
recognition, facial expression robustness and rendering. So 
representation of the scene is bulky and it needs good 
algorithms for real-time rendering and efficient representation. 
Many methods are using Principal Component Analysis 
(PCA). RajKiran Gottumukkal et al. [9] which tested the 
potential of PCA in modular approach and the facial image is 
divided into modules and then PCA is applied over each 
module. 

A real face is described by its 3D shape and texture so it is 
reasonable to use geometry and color or intensity, to improve 
recognition reliability. This is the idea behind 3D+2D face 
recognition. Ashutosh Saxena et al.[8] is based on MRF to 
get the monocular cues from a single still image, and 
respectively convert it into 3D. Belhumeur et al. [5] proposed 
a comparative study of eigenfaces generated by PCA and 
fisherfaces generated by LDA to show that fisherfaces are 
more robust towards expressions. Kresimir Delac et al. [6] 
proposed a comparative study of different pattern recognition 
algorithms ICA, PCA, LDA which provides an excellent 
difference among these algorithms. 

C. Methods for acquiring 3D image Data 

There are various ways for representing 3D face data. 
Point clouds, appearance-based, triangle mesh, layering, 
depth image etc are different approaches for 3D image data. 
Out of these, Depth Images can be computed from the real 
world using cameras or other scanning devices. 

D. Algorithms used for feature extraction 

Principal component analysis (PCA) [5, 9] is a 
mathematical procedure used in transforming a number of 
correlated variables into uncorrelated variables, i.e. principal 
components. PCA calculates the eigenvalue decomposition 
of a data covariance matrix of a data matrix after mean centering 
the data for each attribute.LDA (Linear Discriminant Analysis) 
[5, 6] is an enhancement to PCA which constructs a 
discriminant 
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subspace that minimizes the scatter between images of same 
class and maximizes the scatter between different class 
images. In PCA image elements considers random variables 
with Gaussian distribution and also minimized the second- 
order statistics. But, for non-Gaussian distribution, largest 
variances would not correspond to PCA basis vectors. Now, 
Independent Component Analysis (ICA) minimizes both 
second-order and higher-order dependencies in the input 
data. ICA attempts to find the basis along which the data 
(when projected onto them) are statistically independent. 
SIFT Operator (Scale Invariant Feature Transform) [4, 1,10, 
8] was proposed for extracting distinctive invariant features 
from images that can be invariant to image scale and rotation. 
SURF (Speeded-Up Robust Features) algorithm was first 
proposed by Bay in 2006 [10]. Essentially, it is the 
improvement of SIFT algorithm. At present, SURF has been 
applied to image registration, camera calibration and object 
recognition. Many SIFT or SURF-based researches have been 
carried out in face recognition. In order to enhance robustness 
to expression variations, we propose a two-stage procedure 
of 3D face recognition based on depth image and SURF 
Operator. We use FLD method on the depth image to perform 
coarse recognition, and then we extract the SURF features of 
the 2D gray images to carry out the refined recognition. 

III. Proposed System 

We propose a 3D Face recognition and facial age analysis 
system which includes two steps. 

• First, carry out coarse recognition using FLD on the depth 
images to increase the robustness and recognition rate. 

• FLD is an enhancement to PCA. It constructs a discriminant 
subspace that minimizes the scatter between images of same 
class and maximizes the scatter between different class 
images. 

• Let X 1 , X 2 , . . . , X c be the face classes in the database and 
let each face class X i9 i = 1,2,.. .c has k facial 

images X j9 j =1,2,..., k. 

• The average face is calculated as 

i=\ 7=1 

• Each face differs from the average face by the vector 

Y i j= x u- A 

• The Covariance matrix C is obtained as: 

c k 

i=l 7=1 

• The Eigenvectors are calculated from this covariance matrix. 

• We compute the mean image ]U i of each class X . as: 
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• Now, the mean image JU of all the classes in the database 
can be calculated as: 

c 

• We calculate within-class scatter matrix as: 

S w =ZZ(x k -^Xx k -^.) r 

i=l X k &X t 

• We calculate the between-class scatter matrix as: 

i = l 

• We calculate the projection matrix as: 

w - s s 

LDA °W°B 

• We extract the feature vectors as: 
T -W T W T x 

A ij - LDA PCA ij 

• Secondly, extract the SURF features of the 2D gray images 
corresponding to 3D faces obtained by previous step, to 
perform the refined recognition. 

Distance = sum (( Finaldatatesting - 

Finaldatatraining ). A 2). A 0.5 

M = mean (Distance) 

L = min (Distance) 

Percentage = ((M - L)/M )* 100 

A. Assumptions 

3D Face recognition should overcome the differences 
which occur in faces due to viewing angle, facial expressions, 
illumination etc. In this project we are concerned about the 
differences related to facial expressions, so viewing angle is 
assumed to be constant for all the images. We are taking a 
facial expression database consisting of training images and 
testing images for 3D face recognition system. 

We have used bmp files for both the training and testing 
set of images. We have assumed that the image format remains 
constant throughout the process. Though we have used bmp 
files only, it can work well with other image formats also. The 
size of all the images is assumed to be constant as variation 
in size will lead to resizing of all the images to a constant 
value. The facial images which we have used are of high 
quality and thus noise is ignored. If noisy image is to be 
used, then we need to filter it. 

B. Architecture Specification 

This 3D Face recognition system consists of three 
modules namely acquisition of depth image, feature extraction 
using FLD method based on depth image, recognition using 
SURF operator. 
Acquisition of depth image: 

3D face data is obtained from the 2D image data by the 
use of layering. Layering provides a common colormap to all 
the images. The main concept used for layering is that in any 
image, the part which is closer to the viewer is represented 
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by light colors as compared to the portion which is farther 
away. This concept is used for the conversion of 2D image 
into 3D perceived image. The brighter part of the image 
represents lesser depth as compared to the darker part. 
Feature extraction using FLD method based on depth image: 

Though the dimensions of depth image used in this work 
is reduced after pretreatment, the dimensions is still too high 
to use FLD directly so we are combining PCA with FLD to 
solve this problem. The feature vectors are generated after 
applying PCA and FLD respectively over the images. The 
process of PCA and FLD has been already described above. 
These vectors are used for the similarity measurement. 
Recognition using SURF operator: 

In this module we will compute the recognition rate by 
calculating the similarity between training images and testing 
image using SURF operator. The similarity is calculated by 
calculating the distance between testing and training images. 

IV. RESULTS AND DISCUSSIONS 

In FRAV3D_1 database [12], we have used three classes 
representing three different persons. Each class has 14 images 
representing different expressions of the same person within 
the class. 

A. Output / Results 

In this proposed system, the outputs will vary as per the 
given inputs. We are considering three different possible 
outputs which are given below: 




Figurel. (a) 2D testing image (b) Most Similar Image 
Expression variant testing: 

We have taken a 2D testing image as an input shown in 
Figure 1(a), which is an expression variant image of the images 
already existing in the database. Now, this input is processed 
as per the proposed system and the output will show the 
most similar image of the given input as shown in Figure 1 (b). 
The output will show the class to which the particular input 
image belongs to, as shown in Figure 2. 




Figure2. Matched Class 
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Input testing image is not present in the database: 

We have taken a 2D testing image as an input shown in 
Figure 3(a), whose class does not exist in the database. 




Figure3. (a) 2D Testing Image (b) Match Not Found 

Now, this input is processed as per the proposed system. 
As this particular input image does not exist in our database, 
so it will pop up a window showing that the match is not 
available in the database as shown in Figure 3(b). 
Input image for facial age analysis: 

For facial age analysis, the input image will be an image of 
a child as shown in Figure 4(a). Now, this input is processed 
as per the proposed system and the output will show the 
similar image of elder age of the given input as shown in 
Figure 4(b). 




Figure 1. (a) Younger Image (b) Elder Image 
B. Result Analysis 

The algorithm was tested on MATLAB 7.6.0. The 
implementation had 14 expression samples each of 3 different 
classes. We performed LDA with PC A on the actual samples. 
There are different types of complexity which we go through 
while implementing the algorithm. The experiment was 
repeated with different number of eigenvectors. 

It was observed that, as number of eigenvectors increase 
the recognition rate also increases as shown in Figure 5, but 
at the cost of computational complexity. It was observed that 
LDA with PCA is able to achieve higher rates of recognition 
than only PCA. Using only PCA implementation, the accuracy 
of recognition is low and inconsistent as it is unable to 
recognize images having different expressions and it is very 
much affected due to same illumination of all the images. 
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Figurel. Results of LDA for different Eigenvectors 
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C. Discussion 

From the experiments done over the images, it is found 
that 3D data provides a higher rate of similarity as compared 
to 2D data. It can be found from Figure 6 that there is an 
upward shift in the graph of LDA with 3D. This shows the 
better similarity of the images. It can also be seen in the graph 
that there is less fluctuation in the similar class of LDA with 
3D as compared to the similar class of 2D. But the dissimilarity 
among different classes also decreases in the case of LDA 
with 3D, which can be considered as a drawback of this 
experiment. 

In both the cases i.e. LDA with 2D images and LDA with 
3D images, the curve is smooth around the dissimilar class. 
So it can be concluded that 3D data does not provide much 
difference with 2D data in case of dissimilarity. 
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Figure6. Comparison of LDA in 3D and LDA in 2D 
TAB LEI. Comparison Table 



RECOGNITION 
METHOD 5 


RECOGNITION RATES. (%) 


CASEl 


CASE 2 


CASES 


PCA (2D) 


100 


70.22 


50.06 


FCA+FLIHSTTKPiZDi 


100 


9134 


27.44 


FCA(3D) 


100 


85.57 


33.86 


FCA+FTJHSTTKFi^Di 


100 


97.83 


0.05 



30 



Case I: Testing image is present in database 

Case 2: Testing image is an expression variant image of the 

training set images 

Case 3: Testing image whose class is not present in the 
database. 

Conclusions 

The experiments on the database FRAV3D_I [12] shows 
that face recognition with high accuracy and recognition rate 
is still a challenge. Though 3D face data is more robust to 
expression variation, the high accuracy rate is still a challenge. 
The accuracy rate of 3D face recognition depends on the 
pretreatment of the images. There are various techniques for 
converting a 2D data into 3D data but all of them itself is a 
very broad research area. 3D face recognition technique is 
much more complicated as compared to that of 2D 
techniques. The FLD algorithm is applied over the PCA 
extracted feature vectors for extracting the expression 
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invariant feature vectors. After this, the SURF operator algo- 
rithm is applied to calculate the similarity and dissimilarity. 
The accuracy rate is found to be 97.83%, shown in Table I. 

The same procedure is applied for the age analysis also. 
But it is found that the recognition rate for expression variant 
images is high as compared to age differences. The images 
used for age analysis is a real time image and thus noisy, 
which leads to low recognition rate. Also, only PC A is applied 
on the images, as the database for various expressions was 
not used hence LDA cannot be applied, which also leads to 
a low recognition rate. So, a better approach can be used to 
get a high recognition and accuracy rate. 
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